Multi-mode internal imaging

ABSTRACT

The invention described herein provides systems and methods for multi-modal imaging with light and a second form of imaging. Light imaging involves the capture of low intensity light from a light-emitting object. A camera obtains a two-dimensional spatial distribution of the light emitted from the surface of the subject. Software operated by a computer in communication with the camera may then convert two-dimensional spatial distribution data from one or more images into a three-dimensional spatial representation. The second imaging mode may include any imaging technique that compliments light imaging. Examples include magnetic resonance imaging (MRI) and computer topography (CT). An object handling system moves the object to be imaged between the light imaging system and the second imaging system, and is configured to interface with each system.

CROSS-REFERENCE TO RELATED APPLICATION

This application claims priority under U.S.C. §120 from co-pending U.S.patent application Ser. No. 10/881,707, filed Jun. 29, 2004 andentitled, “MULTI-MODE INTERNAL IMAGING”, which claimed priority under 35U.S.C. §119(e) from co-pending U.S. Provisional Patent Application No.60/484,186 entitled “Multi-Mode Internal Imaging”; both of these patentapplications are incorporated by reference for all purposes.

FIELD OF THE INVENTION

The present invention relates to systems and methods for obtainingmultiple representations of an internal portion of an object, which isparticularly useful in research and imaging applications. In particular,the present invention relates to multi-modal imaging with light andanother type of imaging.

BACKGROUND OF THE INVENTION

Today researchers and imaging practitioners use any one of a number ofnon-invasive imaging techniques to produce an internal image. Thesetechniques employ X-rays, magnetic resonance imaging (MRI), CAT scansand ultrasound. In other systems, optical imaging is used to produceoptical images of an object. For example, bioluminescent imaging is anon-invasive technique for performing in vivo diagnostic studies onanimal subjects in the areas of medical research, pathology and drugdiscovery and development. Bioluminescence is typically produced bycells that have been transfected with a luminescent reporter such asluciferase and can be used as a marker to differentiate a specifictissue type (e.g. a tumor), monitor physiological function, track thedistribution of a therapeutic compound administered to the subject, orthe progression of a disease. Fluorescence is another optical imagingtechnology that can be used to track cells or molecules in vivo. Thistechnology has been demonstrated recently using genetically expressedreporters such as green fluorescent protein (GFP) and near infrared(NIR) dyes such as Cy5. Briefly, fluorescence is a molecular phenomenonin which a substance absorbs light of a particular wavelength and emitslight of a longer wavelength. The absorption of light is referred to asthe “excitation”, and the emission of longer wavelengths as the“emission”.

Each technique has advantages and disadvantages that make it useful fordifferent imaging applications. Some techniques are well suited toprovide spatial or anatomical information for internal parts whileothers are more suited to provide functional information for an activityof interest within an object being imaged.

Researchers are now finding it desirable to combine the output andstrengths of multiple systems. However, the cost of each of thesetraditional imaging systems has become a barrier to such combination;and becomes even more prohibitive when contemplating multiple techniquesat a single site. For instance, an MRI and computer tomography (CT)system can cost millions of dollars. In addition, most traditionalimaging systems have practical complications that inhibit implementationin a multiple imaging system environment. MRI systems require that noferrous metal be near the high power magnet during operation. Positronemission tomography (PET) centers are geographically limited to be closeto a particle accelerator device that produces the short-livedradioisotopes used in the technique. Also, transferring an object to beimaged between different imaging systems would be difficult, such as itwould be difficult to maintain the spatial accuracy provided by eachsystem without compromise due to object transfer between the systems.

Given the foregoing, new systems for performing multiple modes ofimaging would be desirable.

SUMMARY OF THE INVENTION

The present invention provides systems and methods for multi-modalimaging using light and a second form of imaging. Light imaging involvesthe capture of low intensity light from a light-emitting object. The lowintensity light may be emitted from any of a variety of light sourceswithin the object. For example, the light source may correspond toluciferase expressing cells within a living specimen such as a mouse. Acamera obtains a two-dimensional spatial distribution of the lightemitted from the surface of the subject. Software operated by a computerin communication with the camera may convert two-dimensional (2-D)spatial distribution data from one or more images into athree-dimensional (3-D) spatial representation.

The second imaging mode may include any imaging technique thatcompliments light imaging. Examples include magnetic resonance imaging(MRI), computer topography (CT), CAT scans; X-rays; ultrasound; nuclearmedicine imaging such as positron emission tomography (PET), singlephoton emission computed tomography (SPECT), cardiovascular imaging, andbone scanning. The second imaging mode may produce spatial informationthat contributes to a 2-D (pictorial) or 3-D geometric description ofthe object—or its internal portions.

Software operated by a computer in communication with the light imagingsystem and the second imaging system may operate to analyze and combinethe output provided by each imaging system. For example, light imagingsystems are particularly useful to produce functional informationrelating to an activity of interest within the object. This functionalinformation may be combined with spatial information relating tointernal portion of the object as provided by the second imaging system.

An object handling system moves an object to be imaged between the lightimaging system and the second imaging system. The second imaging systemcomprises a receiving area that receives the object from the objecthandling system. The receiving area may also correspond to or comprisethe area in which the object is imaged. For example, an MRI systemusually comprises a tubular cavity passing through a magnetic resonanceimaging magnet. The tubular cavity includes the receiving area, and thehandling system moves the object into the tubular cavity and positionsthe object for MRI imaging. To accommodate the light tight requirementsand imaging chamber used in a low light imaging system, the objecthandling system, light imaging chamber, or both, may include specializedadaptations such as a light seal configured to maintain the low lightlevels employed in the imaging chamber.

In one aspect, the present invention relates to a system for providingmultiple modes of imaging data for an internal portion of an object. Thesystem includes a light imaging system that provides light data relatedto light emitted from a light source located inside the object. Thelight imaging system includes a) an imaging chamber comprising aninterior cavity and b) a camera configured to capture light data fromthe object while the object is in the interior cavity. The system alsoincludes a second imaging system configured to provide imaging data forthe internal portion of the object and having a receiving area thatallows the internal portion to be imaged while the object is in thereceiving area. The system further comprises an object handling systemthat transfers the object between the interior cavity of the lightimaging system and the receiving area of the second imaging system. Thesystem additionally includes at least one processing device in logicalcommunication with the light imaging system, in logical communicationwith the second imaging system, and in logical communication with theobject handling system.

In another aspect, the present invention relates to an object handlingsystem for positioning an object in an interior cavity of an imagingchamber included in a light imaging system. The system comprises aportable stage that supports the object during positioning of the stageby the manipulator. The system also comprises a manipulator configuredto move the portable stage between the interior cavity of the imagingchamber and the ambient area surrounding the imaging chamber. The systemfurther comprises a light seal configured to interface with a light sealon an exterior wall of the imaging chamber and provide a substantiallylight tight seal between the interior cavity of the light imaging systemand the space outside the imaging chamber while the portable stage iswithin the interior cavity of the imaging chamber.

In yet another aspect, the present invention pertains to an imagingsystem for obtaining a representation of a light source located inside asample. The imaging system comprises an imaging chamber includes a) aninterior cavity, b) a camera mount configured to position a camera tocapture light data from the object while the object is in the interiorcavity, and c) a light seal on an exterior wall of the imaging chamber.The imaging system also comprises an object handling system including a)a portable stage that supports the object, b) a manipulator configuredto move the portable stage between the interior cavity of the imagingchamber and the ambient area surrounding the imaging chamber; and c) alight seal associated with the manipulator or portable stage andconfigured to interface with the light seal on the exterior wall of theimaging chamber and provide a substantially light tight seal between theinterior cavity of the light imaging system and the space outside theimaging chamber while the portable stage is within the interior cavityof the imaging chamber.

In another aspect, the present invention relates to a method forobtaining multiple modes of imaging data for an object. The methodcomprises capturing light data emitted from a light source locatedinside the object while the object is in the interior cavity of a lightimaging system. The method also comprises obtaining imaging data of aninternal portion of the object while the object is in a receiving areaof a second imaging system. The method further comprises transferringthe object between the interior cavity of the light imaging system andthe receiving area of the second imaging system.

These and other features of the present invention will be described inmore detail below in the detailed description of the invention and inconjunction with the following figures.

BRIEF DESCRIPTION OF THE DRAWINGS

The present invention is illustrated by way of example, and not by wayof limitation, in the figures of the accompanying drawings and in whichlike reference numerals refer to similar elements and in which:

FIG. 1A illustrates a system for providing multiple modes of imagingdata for an internal portion of an object in accordance with oneembodiment of the present invention.

FIG. 1B illustrates a system for providing light and magnetic resonanceimaging (MRI) imaging data in accordance with one embodiment of thepresent invention.

FIG. 2A is a perspective view of an imaging system adapted to produce a2-D or 3-D representation of a light source located inside an object inaccordance with one embodiment of the invention.

FIG. 2B shows a simplified illustration of light imaging in accordancewith one embodiment of the present invention.

FIGS. 2C and 2D illustrate perspective and side views, respectively, ofan exterior wall opposite a side mounted camera in accordance with oneembodiment of the present invention.

FIG. 3 illustrates a magnetic resonance imaging (MRI) system inaccordance with one embodiment of the present invention.

FIG. 4 illustrates a block representation of a computer topography (CT)system in accordance with one embodiment of the present invention.

FIG. 5 illustrates imaging according to a positron emission tomography(PET) system in accordance with one embodiment of the present invention.

FIG. 6A illustrates an object handling system in accordance with oneembodiment of the present invention.

FIG. 6B illustrates the manipulator of FIG. 6A positioning a portablestage within an MRI receiving area in accordance with one embodiment ofthe present invention.

FIG. 6C shows a second wall around the perimeter of a hole, extendingoutwardly and generally perpendicular to wall in accordance with oneembodiment of the present invention.

FIG. 6D illustrates the manipulator of FIG. 6A positioning a portablestage within an interior cavity of the light-imaging chamber of FIG. 6Ain accordance with one embodiment of the present invention.

FIG. 6E illustrates a light-tight seal in accordance with anotherembodiment of the present invention.

FIG. 7 illustrates an exemplary computer system in accordance with oneembodiment of the present invention.

FIG. 8 illustrates a process flow for obtaining multiple moderepresentations of an object in accordance with one embodiment of thepresent invention.

FIG. 9 illustrates an ultrasound imaging system in accordance with oneembodiment of the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

In the following detailed description of the present invention, numerousspecific embodiments are set forth in order to provide a thoroughunderstanding of the invention. However, as will be apparent to thoseskilled in the art, the present invention may be practiced without thesespecific details or by using alternate elements or processes. In otherinstances well known processes, components, and designs have not beendescribed in detail so as not to unnecessarily obscure aspects of thepresent invention.

1. Overview

FIG. 1A illustrates a simplified system 1 for providing multiple modesof imaging data for an internal portion of an object in accordance withone embodiment of the present invention. System 1 comprises a lightimaging system 10, a second imaging system 8, an object handling system6, and at least one processor 2. The object handling system 6 transfersan object (or sample) being imaged between an interior cavity of thelight imaging system and a receiving area of the second imaging system.While the present invention will now be primarily described with respectto combining data from two imaging systems, system 1 may include morethan two systems and the illustrative embodiment is not meant to limitthe number of systems combined.

Light imaging using system 10 involves the capture of low intensitylight—often on the order of about 10³ to about 10¹⁰photons/second/centimeter squared/steradian—from a light-emittingobject. The low intensity light may be emitted from any of a variety oflight sources within the object. For example, the light source maycorrespond to luciferase expressing cells within a living specimen suchas a mouse. The light source indicates portions of the sample, such astraced molecules in a particular portion of a living specimen, where anactivity of interest may be taking place.

Light imaging system 10 employs a camera to obtain a two-dimensional(2-D) spatial distribution of light emitted from the surface of anobject. To provide details of the light source inside an object (ratherthan a surface emission), processor 2 operates on stored instructions toconstruct a three-dimensional (3-D) representation of a light sourcelocated inside a sample. This involves converting surface light emissiondata into light data internal to the sample surface. Parameters for aninternal 3-D light source representation may include details related tothe source emission strength, 3-D position and geometry.

The second imaging system 8 employs any one of a variety of imagingmodes. Exemplary imaging systems include: magnetic resonance imaging(MRI) systems; computer tomography (CT) systems; CAT scan systems; X-raysystems; ultrasound systems; nuclear medicine imaging systems such aspositron emission tomography (PET) systems, single photon emissioncomputed tomography (SPECT) systems, cardiovascular imaging systems, andbone scanning systems.

Light imaging system 10 and the second imaging system 8 may producespatial and/or functional information. Spatial information refers toinformation that contributes to a 2-D (pictorial) or 3-D geometricdescription of the object or its internal portions. A spatialrepresentation provides a user with a 2-D or 3-D pictorial reference ofthe specimen. A 3-D geometric description typically comprises areconstruction manufactured by processing data from multiple 2-D images.Functional information refers to information that contributes an item oractivity of interest within the object. In one imaging embodiment, lightimaging system 10 produces a 2-D or 3-D representation of abioluminescent light source inside a mouse. The bioluminescent sourcemay correspond to a wide variety of physiological issues being trackedor tested within the mouse, such as progress tracking of a particularcancer within a mouse. Some imaging applications include analysis of oneor more representations of light emissions from internal portions of aspecimen superimposed on a spatial representation of the specimen. Theluminescence representation indicates portions of a specimen where anactivity of interest may be taking place. Some imaging systems 8 or 10produce both spatial and functional information. Light imaging system 10for example is well-suited to generate both structural and functionalinformation. Nuclear medicine uses radioactive substances to image abody and treat disease, and may provide information useful to both thephysiology (functioning) and anatomy (spatial) of the object inestablishing diagnosis and treatment.

At least one processor 2 is in logical communication with the lightimaging system 10, in logical communication with the second imagingsystem 8, and in logical communication with the object handling system6. Communication includes sending data to each system 6, 8 and 10 forpurposes such as control of system components, position and motioncontrol, regulation of image capture, etc. Communication also includesreceiving data from system 6, 8 and 10 components for purposes such asimage data acquisition, component control feedback, calibration, etc.Processor 2 cooperates with stored software and converts imaging sensordata provided by each of the imaging systems, such as camera output fromlight imaging system 10, into a form useful to a system user.

Processor 2 may combine data produced by light imaging system 10 and thesecond imaging system 8. One application of instructions implemented byprocessor 2 reconstructs a bioluminescent or fluorescent light sourceinside a living animal subject using one or more images of surface lightemissions. This provides functional information useful in oncology,infectious disease research, gene expression research, and toxicology,for example. Light imaging according to the present invention issuitable for use with objects having a complex surface, such as ananimal subject (e.g. a mouse or rat). As the term is used herein, acomplex surface is any surface that cannot be described solely using asingle polygonal description. The light reconstruction techniquesemployed herein also place no restrictions on the source distribution,such as the number of light sources in the object or the sizes andshapes of the sources, and no restrictions on the geometry, size orshape of the surface. And as will be described below, processor 2 mayalso combine spatial data from system 8 with light imaging data fromsystem 10.

2. Light Imaging System

FIG. 2A illustrates an imaging system 10 adapted to produce a 2-D or 3-Drepresentation of a light source located inside a sample in accordancewith one embodiment of the present invention. Imaging system 10 may beused for a variety of imaging tasks including the capture ofphotographic, luminescent and structured light images. A computer 28 andits inclusive processor 2 working with imaging system 10 may performprocessing and imaging tasks such as obtaining, analyzing andmanipulating 2-D or 3-D light source representations.

FIG. 2B illustrates a mammalian object 302 being imaged by camera 20 andlight imaging system 10. The nature of mammalian tissue and many otherturbid media causes photon scattering 307 for light traveling from alight source 305 within the object to the object surface 309, resultingin diffuse images on surface 309. Camera 20 captures a representation oflight emitted from object 302 at surface 109. Using photon diffusionmodels and imaging data, a processor 2 in computer 28 operating onstored instructions may produce a 3-D representation for the location,size, and brightness of light source 305 from one or more surface 309images.

Surface light emission data refers to information pertaining to lightescaping an object interior. The light typically escapes from the objectvolume just below the surface. The light source may include luminescencefrom luciferase-expressing cells, fluorescence from fluorescingmolecules, and the like. The object 302 generally refers to variousmammalian subjects including mice and rats containing luciferaseexpressing cells or fluorescent reporters. In one application, sample302 is a biological specimen containing light producing cells. Theresulting luminescence image may therefore be captured without using anylight sources other than the sample itself. Luminescence from sample 302is recorded as a function of position to produce the luminescence image.One approach to generating such composite photographic/luminescenceimages is described in U.S. Pat. No. 5,650,135 issued to Contag et al.on Jul. 22, 1997. The entire disclosure of this patent is incorporatedherein by reference for all purposes. Commonly owned U.S. Pat. No.5,650,135 includes additional examples of analysis applications for adigital overlay image. The entire disclosure of this patent isincorporated herein by reference for all purposes.

Referring to FIG. 2A, system 10 images and processes low intensity lightsources using a light sensitive camera 20. Light from the light sourcerefers to photons and electromagnetic energy anywhere in the visible tonear-infrared (NIR) part of the spectrum in the wavelength range of400-950 nm. It is understood that some intensities imaged and processedin system 10 are not readily detectable by human vision. For example,low intensity light emitted from a sample may have a surface radiancebetween about 10³ to about 10¹⁰ photons/second/centimetersquared/steradian. The lower end of this range is typically well belowhuman detection levels.

In the illustrated embodiment, imaging system 10 includes an imagingchamber 12 adapted to receive a light-emitting sample in which lowintensity light, e.g., luciferase-based luminescence, is to be detected.A high sensitivity camera 20, such as an intensified or a charge-coupleddevice (CCD) camera, couples with the imaging chamber 12. Camera 20 iscapable of capturing luminescent, photographic (i.e., reflection basedimages) and structured light images of sample 302 within imaging chamber12. A refrigeration device 22 cycles a cryogenic fluid to cool camera 20via conduits 24.

An image processing unit 26 optionally interfaces between camera 20 anda computer 28 through cables 30 and 32, respectively. Computer 28, whichmay be of any suitable type, typically comprises a main unit 36 thatcontains hardware including a processor, memory components such asrandom-access memory (RAM) and read-only memory (ROM), and disk drivecomponents (e.g., hard drive, CD, floppy drive, etc.). Computer 28 alsoincludes a display 38 and input devices such as a keyboard 40 and mouse42. Computer 28 is in communication with various components in theimaging chamber 12 via cable 34. In another embodiment, computer 28 isintegrated with the imaging equipment in a single unit.

To provide control and communication for components in system 10,computer 28 is implemented with hardware and software for controllingand monitoring imaging components in system 10. Components controlled bythe computer 28 may include camera 20, the motors responsible for camera20 focus, the camera lens, f-stop, one or more motors coupled to amoveable stage (not shown) included in chamber 12, etc. Computer 28 alsocommunicates with a display 38 for presenting imaging information to theuser and also acts an interface to control the imaging system 10.

Computer 28 includes suitable processing hardware and software for imageprocessing and data manipulation as described herein. For example,computer 28 may be configured with software to build a 3-Drepresentation of a light source using light emission measurements fromthe surface of a sample. In addition, computer 28 may be configured toproduce 3-D surface topography using 2-D structured light images takenfrom one or more positions of the stage in the interior cavity ofchamber 12.

In one embodiment, 3-D light reconstruction techniques requirebioluminescent surface radiance and surface topography measurements overthe entire sample surface. In this case, imaging system 10 includesinstructions and mechanisms for image capture of the object surface frommultiple views and positions. Data from these multiple positions is thenused to build a 3-D representation of the object. System 10 may image in3-D according to the following scheme: 1) camera 20 remains fixed (whenthe various cables and supply lines for cooling the camera are toocumbersome to move during imaging); 2) the sample remains horizontalduring imaging; 3) the imaging system obtains images of the objects frommultiple views and positions; and 4) computer 28 builds a 3-D surfacetopography of the object using the multiple images according toreconstruction instructions stored in software.

The object or animal subject is typically loaded into imaging chamber 12for image capture. Imaging chamber 12 provides multiple options to loadan object into interior cavity 44. FIG. 2C illustrates a top perspectiveview of imaging chamber 12 in accordance with one embodiment of thepresent invention. Door 18 allows a user to manually open and close thedoor and place the object within interior cavity 44.

FIG. 2D illustrates components that permit automated positioning of astage 609 in an interior cavity 44 of chamber 12 in accordance with oneembodiment of the present invention. Enclosure wall 103 a lies oppositea sidewall that receives camera 20. A moveable interface 90 on wall 103a allows the automated object handling system 6 to insert a stage 609into chamber 12 through a hole 91—and move the stage within chamber 12.Moveable interface 90 comprises wall 103 a, wall 92, circular bearing93, circular bearing 94, and an inner collar 95. Inner collar 95 definesthe shape and size of hole 91 through which a portable stage 609 isreceived. When not in use, a cap (not shown) may cover hole 91 and sealany light from entering interior cavity 44. Circular bearing 93 isdisposed between imaging chamber wall 103 a and wall 92 and permitsrotation between the exterior fixed wall 103 and moveable wall 92.Circular bearing 93 permits rotation between the wall 92 and innercollar 95. Cumulatively, bearings 93 and 94 allow hole 91 to trace acircular orbit about a center datum 102. Datum 102 represents a fixedpoint relative to the motion of stage 609 and a common point for imagingthe sample. Bearings 93 and 94 also allow inner collar 95 and stage 609to maintain a constant angle relative to exterior wall 103 while itorbits datum 102. In one embodiment, stage 609 remains horizontal whileorbiting datum 102. Bearings 93 and 94 also allow stage 609 to maintaina constant angle relative to the base of a robotic manipulator 502interfacing with the inner collar 95.

In one embodiment, object handling system 6 is configured to move aportable stage 609 within interior cavity 44. As shown in FIG. 1B,object handling system 6 comprises a track 504 and manipulator 502 formoving stage 609. Track 504 transports stage 609 to the vicinity ofimaging system 10 and allows large movement for the object handlingsystem 6 over large distances, such as between rooms. This finds usewhen imaging system 8 is an MRI system that prefers minimal ferrousmetal nearby or in a room containing the MRI system. Manipulator 502positions and aligns stage 609 in each system 8 and 10. Thus,manipulator 502 inserts stage 609 into hole 91 and also positions stage609 relative to a tubular receiving area for the MRI imaging system 8.More specifically, manipulator 502 establishes the appropriate verticaland horizontal positioning between stage 609 and hole 91 and insertsstage 609 into chamber 12 via hole 91 for light imaging system 10.

Once inside chamber 12, the present invention contemplates multiple waysto position and move stage 609 within cavity 44. In one embodiment,bearings 93 and 94 are passive and the object handling system 6, e.g.,via manipulator 502, moves stage 609 within interior cavity 44 relativeto datum 102. In this case, a processor within computer 28 of FIG. 2Bemploys position control software to convert user input of a desiredlocation for stage 609 to motor positions for motors included inmanipulator 502. In another embodiment as illustrated in FIG. 2D, amotor 95 a and sensor 96 a are coupled to bearing 93 to control rotationof wall 92 relative to exterior wall 103, while a motor 95 b and sensor96 b are coupled to bearing 94 to control rotation of inner collar 95relative to wall 92. In this case, manipulator 502 remains passive whilemotors 95 control the orbital position of stage about fixed datum 102.

Moveable stage 609 allows a light image of the object, or portionsthereof, to be captured by camera 20 from different views, angles, andpositions within imaging chamber 12—without repositioning the posture ofthe object 302. Imaging a sample from multiple views provides additionalinformation that helps build a 3-D internal light source representation.The additional information may be used to constrain 3-D reconstructionmodels stored in software on computer 28, thereby providing a moreaccurate 3-D representation of the object.

Manipulator 502 positions stage 609 in cavity 44. A variety ofcommercially available robotic manipulators 502 offer an end-effectorpositioning schemes suitable for positioning stage 609. One commonscheme employs circular roll, pitch and yaw joints that allow upstreamjoints in the manipulator to achieve redundant positioning of stage 609.One or more upstream joints in manipulator 502 may be configured to movestage 609 in and out of chamber 12. A seal between chamber 12 andmanipulator 502 effectively seals light from the exterior room fromentering into chamber 12 when stage 609 is within chamber 12 (FIG. 6C).

Manipulator 502 may alternatively comprise linear actuators orientedsubstantially perpendicular to one another and attached to an upstreamarm 506 of manipulator 502. Each linear actuator linearly positionsstage 609 in an orthogonal direction. For instance, a first linearactuator provides vertical positioning for stage 609 while a secondlinear actuator provides horizontal positioning for the stage. The firstlinear actuator 206 has a relatively stationary portion attached to anupstream arm or base in manipulator 502 and a portion capable ofvertical linear translation. The second linear actuator 208 may have arelatively stationary portion attached to the first linear actuator anda portion capable of horizontal linear translation. A third linearactuator may also be used to translate stage 609 parallel to the groundand to move stage in and out of chamber 12 through hole 91. An exampleof one such linear actuator suitable for use in manipulator 502 is aLC-33 produced by Thomson Industries of Port Washington, N.Y.

System 1 includes closed loop position control for stage 609 withininterior cavity 44. More specifically, a user, via computer 28, inputsone or more positions for stage 609 along a substantially circular pathabout fixed datum 102. Alternatively, the user may provide a viewingangle for stage 609 relative to a fixed datum 102. Software included incomputer 28 then converts the viewing angle into control signals formoving stage 609 from its current position to the desired position.Motors included in each of the actuators for manipulator 502 receive thecontrol signals provided by computer 28 and position stage 609accordingly. Manipulator 502 and each joint in manipulator 502 mayinclude a position sensor in logical communication with a processorcomputer 28 to facilitate position feedback and control of stage 609.

Light imaging systems 10 suitable for use with the present invention areavailable from Xenogen Corporation of Alameda, Calif. Several lightimaging systems suitable for use with the present invention aredescribed in commonly owned pending U.S. patent application Ser. No.09/905,668 entitled “Multi-View Imaging Apparatus”, listing D. Nilson etal. as inventors and filed on Jul. 13, 2001, which is incorporatedherein by reference for all purposes. 3-D imaging systems suitable foruse with the present invention are further described in commonly ownedpending U.S. patent application Ser. No. 10/606,976 entitled “Method andApparatus for 3-D Imaging of Internal Light Source”, listing D. Stearnset al. and filed on Jun. 25, 2003, which is also incorporated herein byreference for all purposes.

3. Secondary Imaging Systems

In one embodiment, the second imaging system is a magnetic resonanceimaging (MRI) system. FIG. 3 illustrates a magnetic resonance imaging(MRI) system 300 in accordance with one embodiment of the presentinvention. MRI system 300 typically comprises an MRI machine 301 and atleast one processor (such as a processor included in computer 28 fromFIG. 2A) in digital communication with the electronic components of MRIsystem 300. MRI machine 301 may vary in size, shape, and configuration,and some models include openness at the cylindrical sides. As shown, MRImachine 301 includes a horizontal tubular cavity 303 passing through amagnet 304. In this case, cavity 303 runs through magnet 304 from afront face 307 of MRI machine 301 to the back face 309. Tubular cavity303 is also commonly referred to as the bore of magnet 304. An object308 to be imaged rests on a stage 310 that is moved into tubular cavity303. Object handling system 6 positions stage 310 and object 308 intubular cavity 303. The type of exam being performed determines whethera mammalian sample 308 goes in head first or feet first, as well as howfar into the magnet 304 they are positioned. Once the sample portion tobe scanned is in the center or isocenter of the magnetic field formagnet 304, MRI scanning can begin.

MRI machine 301 may employ a magnet 304 from about 0.5-tesla to about60.0-tesla, or about 5,000 to about 600,000 gauss. Using radio wavepulses of energy produced by magnet 304, MRI machine 301 scans theobject and portions inside by proceeding through the sample's body pointby point, building up a 2-D or 3-D map of tissue types currently beingscanned. A processor 2 in electrical communication with machine 301receives the magnetic output and operates on stored softwareinstructions to integrate the scanned information and create 2-D imagesor 3-D models.

MRI system 300 provides a high level of spatial information relative toother imaging modalities. A 3-D model produced by MRI system 300 may beused to assist 3-D light reconstruction, e.g., to produce a surfacerepresentation useful for converting surface light emission data tolight representations internal to object 308. A processor may alsocombine 2-D or 3-D spatial information provided by MRI system 300 with3-D functional information provided by light imaging system 10. Coupledwith the ability to track a biological entity of interest using thebioluminescence techniques described above, MRI system 300 and lightimaging system 10 allow researchers to map progression of a biologicalentity through a particular internal portion of a sample 308 withpreviously unachievable fidelity and salience. In one application,spatial information from MRI system 300 is used to position 3-D lightdata relative to a specific anatomical structure of subject 308. Forexample, the physical size of a tumor within a mammalian sample 308 maybe obtained from MRI system 300 and used to more accurately reconstruct3-D light emission from the tumor provided by light imaging system 10.

Depending on the magnetic field strength used in MRI system 300, theremay be ferrous metallic limitations associated with MRI system usage. Inthis case, stage 310 may be devoid of any ferrous metallic parts. Inaddition, magnet 304—such as a resistive based magnet that includeson/off control—may be shut off during sample transfer. One MRI systemsuitable for use with the present invention is the Bruker BioSpecavailable from Bruker BioSpin of Billerica, Mass.

In another embodiment, the second imaging system 8 is a computertomography imaging (CT) system. Similar to MRI machine 300, a CT systemoffers a high level of spatial information, which may be combined withfunctional information collected by light imaging system 10.

FIG. 4 illustrates a block representation of a computer topography (CT)system 600 in accordance with one embodiment of the present invention.CT system 600 comprises an X-ray CCD camera 602, an object handlingsystem 604, an array of microfocus X-ray tubes 606, and processor 608.Object handling system 604 positions an object 610 resting on a portablestage 609 in a receiving area such that X-rays emitted from CCD camera602 pass through the object 610. The X-rays are then received by themicrofocus X-ray tube array 606. Processor 608 digitally communicateswith each of these devices and runs instructions from stored software tocontrol X-ray emission from CCD camera 602, position sample 610, and toprocess data collected by the microfocus X-ray tube array 606.

CT system 600 yields a series of X-ray-based cross-sectional images ofsolid objects. X-ray intensity profile measurements are typicallyprocessed using reconstruction algorithms that produce an imagerepresenting a two-dimensional slice, or plane, through the material orportion scanned with X-rays. Each point of the slice corresponds to thematerial density. Processor 608 reconstructs a high-resolution image anddetails in the order of 1-10 μm can be detected with microfocus computertomography and industrial microCT scanners, yielding volume elementresolutions in the micrometer range. CT scanning is particularly usefulto reveal internal anatomical features and portions of living andnon-living samples.

CT system 600 also permits acquisition of 3-D volume and/or topologydata. Consecutive cross-sectional images can be stacked to form a 3-Dimage of a portion of sample 610. Scanning the entire sample 610 permitsa full volumetric image to be built. From the 3-D image data,instructions in software can be employed to find part boundaries andcreate computer models and representations of the entire sample 610 orparticular portions of interest. One CT system suitable for use with thepresent invention is the MicroCAT as developed by researchers at OakRidge National Lab managed for the U.S. Department of Energy byUT-Battelle, LLC.

Similar to MRI system 300, CT system 600 provides a high resolutionspatial information that compliments functional information produced bylight imaging system 10. A 3-D model produced by CT system 600 may beused to assist 3-D light reconstruction, e.g., to produce surface orinternal representations useful for converting surface light emissiondata to detailed light representations external or internal to theobject. A processor may combine 2-D or 3-D spatial information providedby CT system 600 with 2-D or 3-D functional information provided bylight imaging system 10. This ability for CT system 600 to producehigh-resolution spatial information for an internal portion of sample610 is useful to reconstruct high detail bioluminescent or fluorescentlight sources, or a source distribution, inside a living animal subject.For example, three-dimensional light data internal to a mouse 610 may bematched with 3-D structural information generated by CT system 600 toproduce a detailed picture of biological activity of an internal organ.This combination of spatial and functional information finds use inoncology, infectious disease research, gene expression research, andtoxicology, for both snapshot imaging and progression tracking.

Nuclear medicine imaging systems 8 give researchers and imagingpractitioners another imaging mode to look inside an object such as amammalian body. Nuclear imaging systems employ radioactive substancesthat emit radioactive particles having known properties, and one or moresensors that detect the radioactive substances and their emissions.Conventional nuclear medicine imaging systems include: positron emissiontomography (PET) systems, single photon emission computed tomography(SPECT) systems, cardiovascular imaging systems, and bone scanningsystems. These systems use different properties of radioactive elementsto create an image. Nuclear medicine imaging is useful for detectingtumors, aneurysms, irregular or inadequate blood flow to varioustissues, blood cell disorders, and inadequate functioning of organs,such as thyroid and pulmonary function deficiencies. Any of thesenuclear medicine imaging systems offer an alternative imaging system 8that compliments the spatial and/or functional information produced bylight imaging system 10. For example, both light imaging and nuclearmedicine imaging may detect tumors in oncology applications.

FIG. 5 illustrates imaging according to a PET system in accordance withone embodiment of the present invention. A PET system produces images ofan object, or a portion thereof, by detecting radiation emitted fromradioactive substances within the object. These substances are injectedinto the object, and are usually tagged with a radioactive atom, such asCarbon-11, Fluorine-18, Oxygen-15, or Nitrogen-13, that has a shortdecay time. In a PET scan, the object is injected with a radioactivesubstance and placed on a flat stage 402 that moves in incrementsthrough a tubular receiving area 405 of a “donut” shaped housing 404.Housing 404 contains a circular gamma ray detector array 406 thatincludes a set of scintillation crystals, each associated with aphotomultiplier tube 408. The crystals convert gamma rays 409, emittedfrom inside the object 410, to photons of light. Photomultiplier tubes408 convert and amplify the photons to electrical signals. Theseelectrical signals are then processed by a processor in digitalcommunication with the photomultiplier tubes that is configured togenerate images based on the electrical signals from photomultipliertubes 408. Stage 402 is then moved through the tubular receiving area405 and the process is repeated, resulting in a series of thin sliceimages of object 410 over an internal portion of interest (e.g. a brain,chest, liver). The processor assembles these thin slice images into athree-dimensional representation of the internal portion. PET isparticularly useful for providing images of blood flow and otherbiochemical functions, depending upon the type of molecule that isradioactively tagged. For example, PET images can show glucosemetabolism or rapid changes in activity in various areas of a body.

Single Photon Emission Computed Tomography (SPECT) is a techniquesimilar to PET, but the radioactive substances used in SPECT (Xenon-133,Technetium-99, Iodine-123) have longer decay times than those used inPET, and emit single instead of double gamma rays. A SPECT system iswell suited to provide information about blood flow and the distributionof radioactive substances in the body. Its images have less sensitivityand are less detailed than PET images, but a SPECT system is lessexpensive than a PET system. Since light imaging system 10 is relativelyinexpensive, a combined SPECT system 8 and light imaging system 10offers a low cost multi-mode imaging alternative.

In another embodiment, the second imaging system 8 comprises anultrasound imaging system. FIG. 9 illustrates an ultrasound imagingsystem 800 in accordance with one embodiment of the present invention.Ultrasound system 800 comprises a probe 802, processor 804, probecontrol 806, memory 808 and display 810.

Ultrasound system 800 transmits high-frequency (e.g., 1 to 5 megahertz)sound pulses in sample 610 using probe 802. Probe 802 generates soundwaves that travel through sample 610 and hit a boundary between tissues(e.g. between fluid and soft tissue, soft tissue and bone). Some soundwaves reflect back to probe 802, while others travel further until theyreach another boundary and get reflected. Probe 802 detects thereflected waves and relays a corresponding signal to processor 804. Theshape of probe 802 determines its field of view, while the frequency ofemitted sound waves typically determine how deep the sound wavespenetrate and the resolution of image data. In one embodiment, probe 802generates and receives sound waves using piezoelectric effects. Forexample, probe 802 may contain one or more crystal elements, and inmultiple-element probes, each crystal may include its own circuit.Multiple-element probes 802 allow an ultrasonic beam to be “steered” bychanging the timing in which each element is pulsed. In addition toprobes 802 that can be moved across the surface of sample 610, someprobes 802 permit insertion through an opening of sample 610 (e.g.,rectum, esophagus) to get closer to an organ being examined (e.g.,prostate gland, stomach).

Processor 804 sends electrical currents to probe 802 that determinesound wave emissions, and receives electrical pulses from probe 802 thatwere created using the returning echoes. Processor 804 calculates thedistance from probe 802 to the reflecting surface or boundaries (e.g., atissue or organ) using the speed of sound in tissue (5,005 ft/s or 1,540m/s) and the time of the each echo's return (usually on the order ofmillionths of a second). Processor 804 may then display the distancesand intensities of echoes on display 810, forming a two dimensionalimage. Processor 804 may also be included in a computer system thatcontains electrical power supplies for probe 802, including anyamplifiers and signal processing electronics. Processor 804 may alsostore the processed data and/or image in memory 808.

Probe controls 806 change the amplitude, frequency and duration of thesonic pulses emitted from transducer probe 802. Probe controls 806 alsoallow an operator to set and change the frequency and duration ofultrasound pulses, as well as a scan mode for system 800. Display 810outputs an image from the ultrasound data provided by processor 804.Memory 808 may include a disk storage device (hard, floppy, CD) thatstores the acquired images and instructions for system 800 dataacquisition and 2-D or 3-D image reconstruction.

Ultrasound system 800 may produce 3-D spatial information. In this case,several 2-D images are acquired by moving probe 802 across a surface ofsample 609 or rotating an inserted probe. The two-dimensional data isthen combined by software stored in memory 808 to form a 3-D image. Someultrasound imaging systems 800 offer 2-D or 3-D spatial image resolutionof anatomical and physiological structures down to 30 microns. Inaddition, a user may view and analyze multiple arbitrary planes andperform volume measurements, such as determining a tumor volume.Ultrasound systems suitable for use with the present invention mayinclude the Vevo 660 as provided by VisualSonics of Toronto, Canada.Ultrasound systems 800 are also relatively inexpensive; a combinedultrasound imaging system 800 and light imaging system 10 thus offers alow cost multi-mode imaging alternative.

4. Object Handling System

An object handling system moves the object to be imaged between thelight imaging system 10 and second imaging system 8. FIG. 6A illustratesan object handling system 700 in accordance with one embodiment of thepresent invention. Object handling system 700 transfers an object 701between an interior cavity 720 of light imaging system 702 and areceiving area 704 of a second imaging system 706.

Object handling system 700 comprises manipulator 708 and a portablestage 710 detachably coupled to manipulator 708. Manipulator 708positions portable stage 710 near light imaging system 702 and thesecond imaging system 706, and may also provide precise positioning andorientation of portable stage 710 within the imaging or receiving areasof each system. As described above, each imaging system 8 comprises areceiving area that receives object 701, which may also correspond to orcomprise the area in which the object is imaged, such as the tubularcavity 303 of an MRI machine. In this case, handling system 700positions object 701 into the tubular cavity 303 and sets position ofstage 710 and object 701 for MRI imaging. Manipulator 708 may includeany number of arms and joints suitable for movement, positioning andorientation of portable stage 710 between or within the two imagingsystems. For example, several commercial robotic manufacturers provide5- and 6-degree of freedom manipulators suitable for payload weightsranging from about 1 kg to about 20 kg. One robotic manipulator suitablefor use with object handling system 700 is the Denso Model VM availablefrom Bruker BioSpin of Billerica, Mass.

When the second imaging system 706 is an MRI imaging system disposed ina second room for magnetic purposes, manipulator 708 may also includetrack 714 to allow for gross movement between rooms. An automated trackinterface 716 travels along track 714 and attaches to the bottom of basearm 718 of manipulator 708. Track interface 716: a) allows manipulator708 to move large distances such as those used between rooms; and b)provides a stationary reference for the first rotary joint of base arm718 (or any other first or base link in a robot). Computer control viaone or more processors, such as those described above, may be used tomove and position manipulator 708 and the automated track interface 716.Collectively, manipulator 708 and track 714 provide both large grossmotion over a long distance and the ability to precisely position andorient portable stage 710.

Object handling system 700 may also be responsible for precisepositioning of object 701 within the interior cavity of imaging chamber712 or another imaging system. FIG. 6B illustrates the manipulator ofFIG. 6A positioning the portable stage within an MRI receiving area inaccordance with one embodiment of the present invention. In this case,manipulator 708 positions and orients portable stage 710 along a centralaxis of the cylindrical central cavity of MRI imaging system 706.

Portable stage 710, which is detachably coupled to the last arm or linkof manipulator 708, supports object 701 during positioning bymanipulator 708. Stage 710 refers generally to any flat surface orportable table suitable to support object 701. In one embodiment, thesame stage 710 supports object 701 in each imaging system and duringtransfer between the imaging systems. Portable stage 710 may comprise aspecialized robotic end effector designed for multiple imaging systemusage. Object 701 rests on portable stage 710 and is positioned byobject handling system 700—without substantially moving between imagingsystems. Accordingly, object handling system 700 may insert and positionstage 710 in interior cavity 720 of imaging chamber 712, remove stage710 from the interior cavity 720, transfer stage 710 to receiving area704 of second imaging chamber 706, and position stage 710 withinreceiving area 704—all without disturbing object 701. This isparticularly advantageous for maintaining the positional accuracyprovided by each imaging system or maintain an anesthesia state for amammalian sample 701. A stage 710 comprising a substantially transparentmesh table or wire array (such as fishing line) supported by anon-metallic perimeter is suitable not to affect imaging in MRI system300. In addition, the stage 710 or light imaging system 10.

To facilitate positional accuracy and object referencing between the twoimaging systems, portable stage 710 comprises a light reference having aposition detectable by the light imaging system 10 and a secondaryreference having a position detectable by a second imaging system 8.Fixturing pegs and other fiducial tools are suitable to provide spatialreferencing information. The pegs and tools may be marked with itemsthat increase detectability for each imaging system. That is, the marksare configured to be optically detectable and distinguishable from theobject 701 under test. Bull's eyes, crosses, bar-codes, known polygonalshapes, etc., having a known location on portable stage 710 are suitableas a positional reference for light imaging system 10. The secondaryreference marking will depend on the type of second imaging system 8.Led markers may be suitable in conjunction with an x-ray system, forexample. An MRI imaging system may reference a positioning peg having ahydrogen source or other distinct material of known density. In aspecific embodiment, the reference position detectable by the lightimaging system 10 and the reference position detectable by the secondimaging system 8 includes the same position on stage 710.

Object handling system 700 is also well suited to position object 701 inthe interior cavity of the light imaging system 704. Referring to FIG.6D, exterior wall 744 of chamber 712 includes a hole 742 that permitsstage 710 access into interior chamber 720. A light imaging chamber 702may be configured such that the interior cavity 720 is substantiallylight tight from the space outside imaging chamber 702. To accommodatethe light tight requirements used in a light imaging system, the objecthandling system 700, light imaging chamber 702, or both, may includespecialized adaptations such as light seals and other parts thatmaintain low light levels employed in imaging chamber 702. In oneembodiment, the object handling system 700 and imaging chamber 702comprise a complementary circular light seal configured to provide asubstantially light tight barrier between interior cavity 720 of imagingchamber 712 and the space outside chamber 712 while portable stage 710is within interior cavity 720. A plug may seal hole 742 when imagingsystem 10 is not in use. Without the plug, hole 742 enables manipulator708 access to interior cavity 720.

FIG. 6C shows a light seal 761 established when manipulator 708positions portable stage 710 within interior cavity 720 in accordancewith one embodiment of the present invention. Wall 750 extends aroundthe perimeter of hole 742, outward from and perpendicular to wall 744.Wall 750 includes a distal edge portion positioned substantiallyadjacent a rear wall 770 on manipulator 708 when manipulator 708positions portable stage 710 within interior cavity 720.

Walls 748 and 750 of imaging chamber 712 cooperate with walls 764 and766 on manipulator 708 to form a capture space 774, which extendsperimetrically around the circular perimeter of hole 742. In this case,the capture space 774 has a rectangular cross-sectional area where avertex A formed by box walls 748 and 750 opposes a vertex B formed bydoor walls 764 and 766. Walls 766, 764 and 770 on manipulator 708cooperate with external surfaces on light imaging box walls 748 and 750to define a capture space 772.

A compressible material 762 attaches to wall 764 of manipulator 708within capture space 772. Compressible material 762 prevents lightpenetration by light from the ambient room into interior cavity 720.When manipulator 708 positions portable stage 710 within interior cavity720, compression of material 762 creates a substantially “light-tight”seal. Compressible material 762 thus minimizes the amount of externallight that enters cavity 720 when manipulator 708 positions portablestage 710 within interior cavity 720. In one embodiment, collar wall 770is adapted to compress the compressible material 762 substantially alonga first side 763 a of compressible material 762 and wall 748 is adaptedto compress compressible material 762 substantially along a side portion763 b when manipulator 708 positions portable stage 710 within interiorcavity 720. Compressible material 762 comprises a non-transparent,preferably black, and resiliently deformable material.

Manipulator 708 comprises a front wall 764, a side wall 766 and a secondwall segment 768. A collar rear wall 770 attaches to an inner surface ofcollar 764 included manipulator 708 to facilitate light sealing with thelight imaging chamber. In a specific embodiment, manipulator 708 collarwall 770 has a wall section 771 that extends perimetrically around hole742 when manipulator 708 positions portable stage 710 within interiorcavity 720. In another embodiment, the wall section 771 extends towardthe body front wall 748 at an orientation engaging a fourth side portion763 d of the compressible material 762 between a second side portion 763b thereof engaged by the body front wall 748 and a first side portion763 a of the compressible material 762 engaged by the manipulator 708collar wall 770.

FIG. 6E illustrates a light-tight seal 61 d in accordance with anotherembodiment of the present invention. Light-tight seal 61 d includes twocompressible materials, 62 d and 62 e, retained inside two channels 77 aand 77 b, respectively. Channel walls 78 and 79, both of which extendfrom manipulator 708, form channel 77 a. Channel 77 b is formed bygenerally parallel channel walls 50 a and 50 b, both of which extendfrom the front wall 48 of chamber 12 and substantially perimetricallyaround hole 91. In this case, channel wall 79 is received in channel 77b when manipulator 708 inserts stage 310 in cavity 44. Thus, channelwall 79 engages the second compressible material 62 e such that lightentering the second channel 77 b from the exterior of the body 14 isintercepted by the second compressible material 62 e.

The materials 62 d and 62 e fill only a portion of the channels 77 a and77 b respectively. In one embodiment, materials 62 d and 62 e fill atmost about ¾ of the channel 75 depth as measured from the walls 70 and48 respectively. In another embodiment, materials 62 d and 62 e fill atmost about ½ the channel depth. In a specific embodiment, materials 62 dand 62 e fill at most about ¼ the channel depth. Thus, the interengagedwalls 50 a and 50 b and channel walls 78 and 79 substantial overlap,relative their respective depth, when manipulator 708 inserts stage 310in cavity 44. Any light attempting to penetrate the light barrierrequires at least six right angle turns (including four through thecompressible materials 62 d and 62 e) before it can enter the interiorcavity 44 from the ambient room.

Light-tight seal 61 d further includes manipulator side wall 66extending outwardly from the manipulator 708 toward the front wall 48when manipulator 708 inserts stage 310 in cavity 44. In this case,manipulator side wall 66 is positioned perimetrically outside andgenerally parallel to the channel walls 78 and 79 and the interengagingfront wall 50. Manipulator 708 further includes a second wall segment 68extending from side wall 66, and oriented substantially adjacent to thefront wall 48 when manipulator 708 inserts stage 310 in cavity 44. Asshown, the second wall segment 68 extends in the inward direction towardinterengaging front wall 50 and the channel walls 78 and 79.

FIG. 6D illustrates manipulator 708 positioning portable stage 710within interior cavity 720 of light imaging chamber 712. In this case,manipulator 708 moves portable stage 710, and object 701 restingthereon, in two dimensions within the interior cavity of the lightimaging chamber 712. More specifically, manipulator 708 moves portablestage 710 in a circular orbit about a camera or common viewing datum inchamber 712. As the object may be variably and multiply located withinchamber 712, a light transport device 711 transmits light emitted orreflected from the object to a common datum associated with a sidemounted camera 20. In one embodiment, the light transport device 711comprises a mirror 713 that rotates with stage 710 about the commondatum and so as to always face object 701 and reflect light from theobject on stage 710, along the common datum, and into fixed camera 20.This allows a light image of the object, or portions thereof, to becaptured by a camera from different views, angles, and positions withinimaging chamber 12 without repositioning the posture of the object 701on stage 710 or moving camera 20.

To facilitate such movement, an exterior wall 740 of imaging chamber 710comprises a) a moveable interface having a hole 742 that receivesportable stage 710 therethrough, b) a first circular bearing 741disposed between exterior wall 740 and a wall 742 of the moveableinterface; and c) a second circular bearing 743 that permits rotationbetween wall 742 and the object handling system 708. Together, circularbearings 741 and 743 permit opposing free rotation—which eliminates anyrelative rotation between stage 710 and chamber 712—and permits stage710 to remain horizontal while moving in an orbital path.

Portable stage 710 allows imaging to be conducted in multiple imagingsystems 8 and 10 without disturbing the object 701. For an animal 701,turning or flipping the animal over to view a ventral side results in asignificant shift in the animal's internal organ position, which couldaffect observation. Imaging in each of the systems 8 and 10 and transferbetween the systems may require significant time. Obtaining aluminescence representation may also involve image capture over anextended period, such as several minutes. To prevent movement of aliving specimen during imaging, object handling system 700 may comprisean anesthesia delivery system that delivers anesthesia gas to outlets inproximity to one or more living specimens. The anesthesia deliverysystem is also useful for anesthetizing living specimens during transferbetween imaging systems. An exemplary anesthesia delivery system and gasdelivery system suitable for use with the present invention aredescribed in commonly owned co-pending U.S. patent Ser. No. 10/081,040(Attorney Docket No. XENOP008), entitled “Multiple Output AnesthesiaSystem” by Richard George Dalgetty et al. filed on Feb. 20, 2002, whichis incorporated herein by reference for all purposes.

Imaging techniques described herein are implemented in conjunction witha suitable processor or computer-based apparatus. Referring to FIG. 7,an exemplary computer system 350 includes a central processing unit(CPU) 352, read only memory (ROM) 354, random access memory (RAM) 356,expansion RAM 358, input/output (I/O) circuitry 360, display assembly362, input device 364, and expansion bus 366. Computer system 350 mayalso optionally include a mass storage unit 368 such as a disk driveunit or nonvolatile memory such as flash memory and a real-time clock360. Mass storage unit 368 may include units which utilizes removablecomputer readable media, such as floppy disks, opto-magnetic media,optical media, and the like for the storage of programs and data.

CPU 352 is preferably a commercially available microprocessor such asone of the Intel (including Pentium™) or Motorola family of chips, areduced instruction set computer (RISC) chip such as the PowerPC™microprocessor available from Motorola, Inc, or any other suitableprocessor. CPU 352 is coupled to ROM 354 by a data bus 372, control bus374, and address bus 376. ROM 354 may partially contain the basicoperating system for the computer system 350. CPU 352 is also connectedto RAM 356 by busses 372, 374, and 376 to permit the use of RAM 356 asscratch pad memory. Expansion RAM 358 is optionally coupled to RAM 356for use by CPU 352. CPU 352 is also coupled to the I/O circuitry 360 bydata bus 372, control bus 374, and address bus 376 to permit datatransfers with peripheral devices.

Via suitable I/O inputs, CPU 352 is in logical communication with lightimaging system 10, in logical communication with the second imagingsystem 8, and in logical communication with the object handling system6. CPU 352 operates on stored instructions to combine spatialinformation provided by the second imaging system 8 with informationprovided by the light imaging system 10. ROM 354 may store the imageprocessing instructions. ROM 354 may also store protocol for controllingthe object handling system 6 according to positioning needs of themulti-modal imaging system, e.g., store proprietary robotic controlcommands that dictate robot movement according to positioninginstructions for the imaging.

I/O circuitry 360 typically includes a number of latches, registers anddirect memory access (DMA) controllers. The purpose of I/O circuitry 360is to provide an interface between CPU 352 and such peripheral devicesas display assembly 362, input device 364, mass storage 368, and/or anyother I/O devices in imaging systems 8 and 10. I/O circuitry 360 mayalso include analog-to-digital (A/D) converters, digital-to-analog (D/A)converters, as well as other control circuits for controlling andreceiving feedback data from the I/O devices. Display assembly 362 ofcomputer system 350 is an output device for displaying objects and othervisual representations of data.

The screen for display assembly 362 can be a device that uses acathode-ray tube (CRT), liquid crystal display (LCD), or the like, ofthe types commercially available from a variety of manufacturers. Inputdevice 364 can be a keyboard, a mouse, a stylus working in cooperationwith a position-sensing display, or the like. Alternatively, inputdevice 364 can be an embedded RF digitizer activated by an “active” RFstylus. As a further alternative, input device 364 may be any type ofswitch capable of communicating a test subject's response to computersystem 350. Therefore, as used herein, the term input device will referto any mechanism or device for entering data and/or pointing to aparticular location on a screen of a computer display. One or more inputdevices may be provided to control computer 350 and/or to receiveresponses from the test subject. The aforementioned input devices areavailable from a variety of vendors and are well known in the art.

Some type of mass storage 368 is generally considered desirable.However, mass storage 368 can be eliminated by providing a sufficientamount of RAM 356 and expansion RAM 358 to store user applicationprograms and data. In that case, RAMs 356 and 358 can optionally beprovided with a backup battery to prevent the loss of data even whencomputer system 350 is turned off. However, it is generally desirable tohave some type of long term mass storage 368 such as a commerciallyavailable hard disk drive, nonvolatile memory such as flash memory,battery backed RAM, PC-data cards, or the like.

Regardless of computer system 350 configuration, it may employ one ormore memories or memory modules configured to store program instructionsfor robotic control, obtaining a three-dimensional representation of alight source, and other imaging functions of the present inventiondescribed herein. Such memory or memories may also be configured tostore data structures, imaging data, or other specific non-programinformation described herein. It should be borne in mind that althoughcomputer system 350 is discussed in some detail herein to facilitatediscussion, the invention may be practiced using a variety of suitablecomputer-implemented techniques. In general, any suitable computersystem may be employed for obtaining a three-dimensional representationof a light source located inside a sample.

Because information and program instructions may be employed toimplement the systems/methods described herein, the present inventionrelates to machine-readable media that include program instructions,state information, etc. for performing various operations describedherein. Examples of machine-readable media include, but are not limitedto, magnetic media such as hard disks, floppy disks, and magnetic tape;optical media such as CD-ROM disks; magneto-optical media such asfloptical disks; and hardware devices that are specially configured tostore and perform program instructions, such as read-only memory devices(ROM) and random access memory (RAM). Examples of program instructionsinclude both machine code, such as produced by a compiler, and filescontaining higher level code that may be executed by the computer usingan interpreter.

FIG. 8 illustrates a process flow 900 for obtaining multiple types ofimaging data for an object in accordance with one embodiment of thepresent invention. Processes in accordance with the present inventionmay include up to several additional steps not described or illustratedherein in order not to obscure the present invention.

Process flow 900 begins by capturing light data emitted from a lightsource located inside the object while the object is in the interiorcavity of a light imaging system (902). For imaging system 10, thesurface light emission data is contained in images captured by camera20. The images include a set of measurements of the light emission overone or more portions of the surface. In one embodiment, multiple imagesof the sample are obtained from multiple views of the sample relative toa camera. In this case, each image provides a different two-dimensionalview of the surface light emission from the sample. Multiple images maybe taken to provide additional data from multiple angles.

Process flow 900 then continues by obtaining imaging data of an internalportion of the object while the object is in a receiving area of asecond imaging system (904). When the second imaging system is amagnetic resonance imaging system, obtaining imaging data comprisesreceiving the imaging data using a magnetic resonance imaging magnet.For a computer tomography imaging system, obtaining imaging datagenerally comprises receiving the imaging data using an array of X-raysensors that detect X-rays emitted from the object.

It is understood that light imaging or the imaging in the second imagingsystem occurs in no set order. Regardless of which imaging system isused first, the object is transferred between the interior cavity of thelight imaging system and the receiving area of the second imaging system(906). In one embodiment, the transfer occurs without substantiallymoving the object on the portable stage that the object rests upon.Transfer may also comprise sealing the light imaging chamber, while theportable stage is within the interior cavity of the light imagingchamber, using a light seal included in the object handling system.

Process flow 900 may also combine the output of each imaging system. Forexample, software and user input may be used to combine spatial dataprovided by the magnetic resonance imaging system with functional dataprovided by the light imaging system. In some cases, software maycombine three-dimensional spatial information provided by an MRI orcomputer tomography system with three-dimensional functional informationprovided by the light imaging system.

3-D light reconstruction techniques may be employed to reconstruct lightdata emitted from a sample surface. The reconstruction techniques usedata that provides information about the geometry of the sample and thespatial distribution of the light emission from the sample surface. Thismay include data that comprises a) a surface representation of thesample (e.g., from the second system 8), and b) a set of measurements(e.g. images) of the light emission over at least a portion of thesurface. One format for this data comprises (1) a surface representationdefining the surface of the sample, (2) a set of light emission imagesfrom the sample surface, and (3) a set of parameters that define thespatial relationship between the sample and each image. 3-D lightreconstruction then comprises converting surface light image data intolight data internal to the object surface to obtain a three-dimensionalrepresentation of the internal light source. This may include creating aset of volume elements within the object.

A surface representation may also be obtained via the secondary imagingsystem or structured light techniques. For example, three-dimensionalspatial information provided by a computer tomography imaging system 8may be used to build a surface representation. To facilitate light 3-Dlight reconstruction, the surface representation is divided into surfaceelements or a suitable surface mesh approximating the actual surface ofthe sample. For example, the surface mesh may be defined by a set ofconnected polygons, where each polygon is a surface element. The numberof surface elements varies according to the object size and a desiredsolution accuracy. Accuracy of a surface representation generallyimproves by increasing the number of surface elements.

While this invention has been described in terms of several preferredembodiments, there are alterations, permutations, and equivalents whichfall within the scope of this invention which have been omitted forbrevity's sake. For example, although imaging chamber 12 is describedwith multiple options for object access into interior cavity 44, it isunderstood that the present invention may include only one form ofaccess (e.g., manual access or automated access, not both). It istherefore intended that the scope of the invention should be determinedwith reference to the appended claims.

1. A system for providing multiple types of imaging data for an internalportion of an object, the system comprising: a light imaging system forproviding light data related to light emitted from a light sourcelocated inside the object, the light imaging system including an imagingchamber comprising an interior cavity, and a camera configured tocapture light data from the object while the object is in the interiorcavity; a second imaging system configured to provide imaging data forthe internal portion of the object and having a receiving area thatallows the internal portion to be imaged while the object is in thereceiving area; and an object handling system for transferring theobject between the interior cavity of the light imaging system and thereceiving area of the second imaging system.
 2. The system of claim 1wherein the object handling system comprises a portable stage thatsupports the object during light imaging in the light imaging system andimaging in the second imaging system.
 3. The system of claim 2 whereinthe object handling system is configured to transfer the object betweenthe interior cavity of the light imaging system and the receiving areaof the second imaging system without substantially moving the object onthe portable stage.
 4. The system of claim 2 further comprising a gasdelivery system configured to deliver an anesthesia gas to at least onegas delivery outlet that provides the anesthesia gas to the object whilethe object rests on the portable stage.
 5. The system of claim 1 whereinthe second imaging system is configured to produce spatial informationfor the internal portion.
 6. The system of claim 5 wherein the lightimaging system is configured to produce functional information for theinternal portion.
 7. The system of claim 6 wherein the second imagingsystem is configured to produce three dimensional spatial informationfor the internal portion and the light imaging system is configured toproduce three dimensional functional information for the internalportion.
 8. The system of claim 1 wherein the imaging chamber isconfigured such that the interior cavity is substantially light tightfrom the space outside the imaging chamber.
 9. The system of claim 1wherein the object handling system is configured to move the objectwithin the interior cavity of the imaging chamber.
 10. The system ofclaim 7 wherein an exterior wall of the imaging chamber comprises amoveable interface having: a hole that receives the portable stagetherethrough; a first circular bearing disposed between the exteriorwall and a wall of the moveable interface and permits rotation betweenthe exterior wall and the wall of the moveable interface; and a secondcircular bearing that permits rotation between the wall of the moveableinterface and the object handling system.
 11. The system of claim 1wherein the computer tomography system is configured to acquire topologyinformation for the object.
 12. The system of claim 11 wherein theprocessing device is configured to use the topology information toassist three dimensional reconstruction of the light source locatedinside the object.
 13. A system for providing multiple types of imagingdata for an internal portion of an object, the system comprising: alight imaging system for providing light data related to light emittedfrom a light source located inside the object, the light imaging systemincluding an imaging chamber comprising an interior cavity, and a cameraconfigured to capture light data from the object while the object is inthe interior cavity; a computer tomography system including an X-rayproducer configured to emit X-rays that pass through the object whileresting on a portable stage included in the object handling system andpositioned in the receiving area, and an array of X-ray sensors thatreceive the X-rays; an object handling system for transferring theobject between the interior cavity of the light imaging system and thereceiving area of the computer tomography system; and a processingdevice in logical communication with the light imaging system, inlogical communication with the computer tomography system, and inlogical communication with the object handling system, wherein theprocessor combines three-dimensional spatial information provided by thecomputer tomography system with three-dimensional functional informationprovided by the light imaging system.
 14. The system of claim 13 whereinthe object handling system comprises a portable stage that supports theobject during light imaging in the light imaging system and imaging inthe computer tomography system.
 15. The system of claim 13 wherein thecomputer tomography system is configured to acquire topology informationfor the object.
 16. The system of claim 15 wherein the processing deviceis configured to use the topology information to assist threedimensional reconstruction of the light source located inside theobject.
 17. A system for providing multiple types of imaging data for aninternal portion of an object, the system comprising: a light imagingsystem for providing light data related to light emitted from a lightsource located inside the object, the light imaging system including animaging chamber comprising an interior cavity, and a camera configuredto capture light data from the object while the object is in theinterior cavity; a magnetic resonance imaging system including a tubularcavity passing through a magnetic resonance imaging magnet, the tubularcavity comprising the receiving area that receives the object whileresting on a stage included in the object handling system; an objecthandling system for transferring the object between the interior cavityof the light imaging system and the receiving area of the second imagingsystem; and at least one processing device in logical communication withthe light imaging system, in logical communication with the magneticresonance imaging system, and in logical communication with the objecthandling system, wherein the processor combines three-dimensionalspatial information provided by the magnetic resonance imaging systemwith three-dimensional functional information provided by the lightimaging system.
 18. The system of claim 17 wherein the object handlingsystem comprises a portable stage that supports the object during lightimaging in the light imaging system and imaging in the computertomography system.
 19. The system of claim 18 wherein the portable stageincludes no metal parts.
 20. The system of claim 17 wherein the objecthandling system is configured to transfer the object between theinterior cavity of the light imaging system and the receiving area ofthe computer tomography system without substantially moving the objecton the portable stage.
 21. The system of claim 17 wherein the magneticresonance imaging system is configured to acquire topology informationfor the object.
 22. The system of claim 21 wherein the processing deviceis configured to use the topology information to assist threedimensional reconstruction of the light source located inside theobject.
 23. A system for providing multiple types of imaging data for aninternal portion of an object, the system comprising: a light imagingsystem for providing light data related to light emitted from a lightsource located inside the object, the light imaging system including animaging chamber comprising an interior cavity, and a camera configuredto capture light data from the object while the object is in theinterior cavity; a second imaging system configured to provide imagingdata for the internal portion of the object and having a receiving areathat allows the internal portion to be imaged while the object is in thereceiving area; and an object handling system for transferring theobject between the interior cavity of the light imaging system and thereceiving area of the second imaging system, wherein the object handlingsystem includes a light seal that is configured to interface with alight seal on an exterior wall of the imaging chamber and provide asubstantially light tight seal between the interior cavity of the lightimaging system and the space outside the imaging chamber while theportable stage is within the interior cavity of the imaging chamber. 24.The system of claim 23 wherein the object handling system comprises aportable stage that supports the object during light imaging in thelight imaging system and imaging in the second imaging system.
 25. Thesystem of claim 24 wherein the object handling system is configured totransfer the object between the interior cavity of the light imagingsystem and the receiving area of the second imaging system withoutsubstantially moving the object on the portable stage.
 26. The system ofclaim 24 wherein the imaging chamber is configured such that theinterior cavity is substantially light tight from the space outside theimaging chamber when the object is on the stage and in the interiorcavity.
 27. The system of claim 23 wherein the object handling system isconfigured to move the object within the interior cavity of the imagingchamber.
 28. The system of claim 23 wherein an exterior wall of theimaging chamber comprises a moveable interface having: a hole thatreceives the portable stage therethrough; a first circular bearingdisposed between the exterior wall and a wall of the moveable interfaceand permits rotation between the exterior wall and the wall of themoveable interface; and a second circular bearing that permits rotationbetween the wall of the moveable interface and the object handlingsystem.
 29. A system for providing multiple types of imaging data for aninternal portion of an object, the system comprising: a light imagingsystem for providing light data related to light emitted from a lightsource located inside the object, the light imaging system including animaging chamber comprising an interior cavity, and a camera configuredto capture light data from the object while the object is in theinterior cavity; a nuclear medicine imaging system including one or moresensors that detect radioactive emissions produced by a radioactivesubstance within the object when the object is in a receiving area forthe nuclear medicine imaging system, wherein the nuclear medicineimaging system is one of a positron emission tomography system and asingle photon emission computed tomography system; and an objecthandling system for transferring the object between the interior cavityof the light imaging system and the receiving area of the second imagingsystem.
 30. The system of claim 29 wherein the nuclear medicine imagingsystem is configured to acquire structural information for the object.31. The system of claim 30 wherein the nuclear medicine imaging systemis configured to acquire topology information for the object.
 32. Thesystem of claim 29 wherein the nuclear medicine imaging system isconfigured to acquire functional information related to a tumor insidethe object.
 33. A system for providing multiple types of imaging datafor an internal portion of an object, the system comprising: a lightimaging system for providing light data related to light emitted from alight source located inside the object, the light imaging systemincluding an imaging chamber comprising an interior cavity, and a cameraconfigured to capture light data from the object while the object is inthe interior cavity; a positron emission tomography system including oneor more sensors that detect radioactive emissions produced by aradioactive substance within the object when the object is in areceiving area for the nuclear medicine imaging system, and including acircular gamma ray detector array that includes a set of scintillationcrystals each connected to a photomultiplier tube; and an objecthandling system for transferring the object between the interior cavityof the light imaging system and the receiving area of the second imagingsystem.
 34. The system of claim 33 wherein the positron emissiontomography system is configured to acquire structural information forthe object.
 35. The system of claim 34 wherein the positron emissiontomography system is configured to acquire topology information for theobject.
 36. The system of claim 33 wherein the positron emissiontomography system is configured to acquire functional informationrelated to a tumor inside the object.
 37. A method for obtainingmultiple types of imaging data for an object, the method comprising:capturing light data emitted from a light source located inside theobject while the object is in the interior cavity of a light imagingsystem, wherein the interior cavity of the light imaging chambercontains between about 10³ to about 10¹⁰ photons/second/centimetersquared/steradian when the light data is captured; and obtaining imagingdata of an internal portion of the object while the object is in areceiving area of a second imaging system.
 38. The method of claim 37wherein the second imaging system is separate from the light imagingsystem.
 39. The method of claim 37 wherein the second imaging system isa magnetic resonance imaging system.
 40. The method of claim 37 whereinthe second imaging system is a computer tomography imaging system andobtaining imaging data comprises receiving the imaging data using anarray of X-ray sensors that detect the X-rays emitted from the object.41. The method of claim 40 further comprising: combiningthree-dimensional spatial information provided by the computertomography imaging system with three-dimensional functional informationprovided by the light imaging system.
 42. The method of claim 37 furthercomprising obtaining anatomical information regarding the object fromthe second imaging system and using the anatomical information to obtainthe three-dimensional representation of the light source located insidethe object.